Critical Computation, Phase Transitions, and Hierarchical Learning
نویسنده
چکیده
A study of the various routes to chaos in dynamical systems reveals that significant computation occurs at the onset of chaos. At first blush this is not surprising since statistical mechanics views these as phase transitions with infinite temporal correlations. In computational terms processes that are in a critical state, like those at the onset of chaos considered here, have an infinite memory. Storage capacity, however, is only part of information processing. The set of available nonlinear operations and just how the memory is organized are more important determinants of the class of computation that can be supported. This leads directly to studies of the architecture of information processing and to quantitative measures of complexity. There is a universal theory, for example, that indicates how complexity trades-off against the rate at which information is produced. This result suggests a new view of how learning and control systems can break out of inadequate internal models to discover genuinely new representations. Proceedings of the 7th Toyota Conference, Lake Hamana, Shizuoka, Japan
منابع مشابه
Efficient Reinforcement Learning with Hierarchies of Machines by Leveraging Internal Transitions
In the context of hierarchical reinforcement learning, the idea of hierarchies of abstract machines (HAMs) is to write a partial policy as a set of hierarchical finite state machines with unspecified choice states, and use reinforcement learning to learn an optimal completion of this partial policy. Given a HAM with deep hierarchical structure, there often exist many internal transitions where ...
متن کاملSpeeding Up HAM Learning with Internal Transitions
In the context of hierarchical reinforcement learning, the idea of hierarchies of abstract machines (HAMs) is to write a partial policy as a set of hierarchical finite state machines with unspecified choice states, and use reinforcement learning to learn an optimal completion of this partial policy. Given a HAM with potentially deep hierarchical structure, there often exist many internal transi...
متن کاملMagnetic Properties and Phase Transitions in a Spin-1 Random Transverse Ising Model on Simple Cubic Lattice
Within the effective-field theory with correlations (EFT), a transverse random field spin-1 Ising model on the simple cubic (z=6) lattice is studied. The phase diagrams, the behavior of critical points, transverse magnetization, internal energy, magnetic specific heat are obtained numerically and discussed for different values of p the concentration of the random transverse field.
متن کاملBridging the semantic gap for software effort estimation by hierarchical feature selection techniques
Software project management is one of the significant activates in the software development process. Software Development Effort Estimation (SDEE) is a challenging task in the software project management. SDEE is an old activity in computer industry from 1940s and has been reviewed several times. A SDEE model is appropriate if it provides the accuracy and confidence simultaneously before softwa...
متن کاملInvestigation of the Critical Point in Models of the Type of Dyson's Hierarchical Models
We consider the classical spin models where the Hamiltonians are small modifications of the Hamiltonians of Dyson's hierarchical models. Under some assumptions we investigate rigorously the neighbourhood of the critical point and find the critical indices. It follows that in the cases under consideration phenomenologicat Landau's theory of phase transitions is valid.
متن کامل